CLAIMS 



What is claimed is: 

1. A method comprising: 

receiving data to create a synthetic scene comprising at least one dynamic 
synthetic object; 

receiving data reflective of at least one real dynamic object corresponding to the 
at least one dynamic synthetic object; and 

generating a synthetic scene comprising the at least one dynamic synthetic object 
using data reflective of the at least one corresponding real dynamic object. 

2. The method as set forth in claim 1, further comprising combining the at 
least one synthetic object with a live broadcast such that the synthetic object appears at 
least a part of the broadcast. 

3. The method as set forth in claim 1 , further comprising specifying a 
synthetic camera including a synthetic field of view of the synthetic camera, said 
generating comprising displaying the synthetic scene within the synthetic field of view. 

4. The method as set forth in claim 3, wherein the synthetic field of view is 
set according to a criteria selected from the group consisting of following a position of 
the at least one real dynamic object, specification by a viewer, correspondence to a field 
of view of a real camera. 

5. The method as set forth in claim 3, wherein the data reflective of the at 
least one corresponding real dynamic object comprises position information of the real 
dynamic object. 

6. The method as set forth in claim 3, wherein the synthetic scene 
corresponds to a one of live or recorded audio/visual (AA^) data. 
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7. The method as set forth in claim 6, wherein the AA^ data comprises a 
broadcast. 

8. The method as set forth in claim 6, wherein the synthetic camera is 
specified to correspond to a real camera of the AA'^ data. 

9. The method as set forth in claim 1, further comprising: 

setting a synthetic field of view to correspond to a field of view of a real camera 
recording real images; 

combining the synthetic scene within the synthetic field of view with real images 
within the field of view of the real camera. 

10. A client device comprising: 

a first input coupled to receive data to create a synthetic scene comprising at least 
one dynamic synthetic object; 

a second input coupled to receive data reflective of at least one dynamic real 
object corresponding to the at least one dynamic synthetic object; and 

a processing device configured togenerate a synthetic scene comprising the at 
least one dynamic synthetic object using data reflective of the at least one corresponding 
dynamic real object. 

1 1 . The chent device as set forth in claim 10, wherein the processor is further 
configured to combine the at least one synthetic object with a live broadcast such that the 
synthetic object appears at least a part of the broadcast. 

12. The client device as set forth in claim 10, further comprising specifying a 
synthetic camera including a synthetic field of view of the synthetic camera, said 
generating comprising displaying the synthetic scene within the synthetic field of view. 

13. The client device as set forth in claim 12, wherein the synthetic field of 
view is set according to a criteria selected from the group consisting of following a 
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position of the at least one real dynamic object, specification by a viewer, 
correspondence to a field of view of a real camera. 



14. The client device as set forth in claim 10, wherein the data reflective of 
the at least one corresponding real dynamic object comprises position information of the 
real dynamic object. 

15. The client device as set forth in claim 12, wherein the synthetic scene 
corresponds to a one of hve or recorded audio/visual (A/V) data. 

16. The client device as set forth in claim 15, wherein the AA^ data comprises 
a broadcast. 

17. The client device as set forth in claim 15, wherein the synthetic camera is 
specified to correspond to a real camera of the A/V data. 

18. The cUent device as set forth in claim 10, wherein the processor is further 
configured to set a synthetic field of view to correspond to a field of view of a real 
camera recording real images and combine the synthetic scene within the synthetic field 
of view with real images within the field of view of the real camera. 

19. The client device as set forth in claim 10, wherein the client device is 
selected from the group consisting of a signal processor, general purpose processor, set 
top box and video game console. 

20. A system comprising: 

a broadcast server configured to provide data to create a synthetic scene 
comprising at least one dynamic synthetic object, data reflective of at least one dynamic 
real object corresponding to the at least one dynamic synthetic object; 

a client device coupled to the broadcast server, said device receiving data to 
create a synthetic scene comprising at least one dynamic synthetic object, receiving data 
reflective of at least one real dynamic object corresponding to the at least one dynamic 
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synthetic object, and generating a synthetic scene comprising the at least one dynamic 
synthetic object using data reflective of the at least one corresponding real dynamic 
object. 

21 . The system as set forth in claim 20, said broadcast server further 
configured to provide a hve broadcast, said client device further configured to combine 
at least a portion of the synthetic scene with the live broadcast. 

22. The system as set forth in claim 21 , further comprising specifying a 
synthetic camera including a synthetic field of view of the synthetic camera, said client 
device displaying the synthetic scene within the synthetic field of view. 

23. The system as set forth in claim 22, wherein the synthetic field of view is 
set according to a criteria selected from the group consisting of following a position of 
the at least one real dynamic object, specification by a viewer at the client device, 
correspondence to a field of view of a real camera coupled to the broadcast server. 

24. The system as set forth in claim 21, wherein the data reflective of the at 
least one corresponding real dynamic object comprises position information of the real 
dynamic object. 

25. The system as set forth in claim 24, wherein the position information is 
communicated frequently from the broadcast server to the client device such the 
synthetic scene comprising the at least one dynamic synthetic object is frequently 
updated to correspond to the corresponding dynamic real object. 

26. The system as set forth in claim 22, wherein the processor is further 
configured to set a synthetic field of view to correspond to a field of view of a real 
camera recording real images and combine the synthetic scene within the synthetic field 
of view with real images within the field of view of the real camera. 
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27. The client device as set forth in claim 20, wherein the client device is 
selected from the group consisting of a signal processor, general purpose processor, set 
top box and video game console. 

28. A broadcast device a configured to provide data to create a synthetic 
scene comprising at least one dynamic synthetic object, data reflective of at least one 
dynamic real object corresponding to the at least one dynamic synthetic object; vi'herein a 
synthetic scene comprising the at least one dynamic synthetic object using data reflective 
of the at least one corresponding real dynamic object is generated. 

29. The broadcast device as set forth in claim 28, said broadcast device 
further configured to provide a live broadcast, vi'herein at least a portion of the synthetic 
scene is combined with the live broadcast. 

30. The broadcast device as set forth in claim 28, said broadcast device 
further configured to specify a synthetic camera including a synthetic field of view of the 
synthetic camera, wherein the synthetic scene is displayed within the synthetic field of 
view. 

31. The broadcast device as set forth in claim 30, wherein the synthetic field 
of view is set according to a criteria selected from the group consisting of following a 
position of the at least one real dynamic object, specification by a viewer at the client 
device, correspondence to a field of view of a real camera coupled to the broadcast 
server. 

32. The broadcast device as set forth in claim 28, wherein the data reflective 
of the at least one corresponding real dynamic object comprises position information of 
the real dynamic object. 

33. The broadcast device as set forth in claim 32, wherein the position 
information is updated frequently such the synthetic scene comprising the at least one 



Application 



16 



Atty Docket No. 80398.P445 



dynamic synthetic object is frequently updated to correspond to the corresponding 
dynamic real object. 

34. The broadcast device as set forth in claim 29, said broadcast device 
further configured to set a synthetic field of view to correspond to a field of view of a 
real camera recording the Uve broadcast and combine the synthetic scene within the 
synthetic field of view with real images within the field of view of the real camera. 
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